Mode based film mode detection

ABSTRACT

In general, in one aspect, the frames of a received video are analyzed using traditional film mode detection (continually capturing data and comparing the data to known parameters for various film modes) until a film mode is detected. Once the film mode is detected, the frames of the received video are analyzed using mode based tracking where measurements are continually predicted based on the mode detected and averaged with actual measurements. The use of the averaged measurements limit the effect of noise captured in the actual measurements. The averaged measurements are continually compared to known parameters for the detected mode to determine if the detected mode is still valid. If the detected mode is valid, the mode based tacking is continued. If the detected mode is no longer valid (e.g., averaged measurements not correlated with known parameters), the process returns to the traditional film mode detection.

BACKGROUND

Video is a series of frames (still images) captured in rapid succession.Video may be recorded, displayed, stored and/or transmitted byprogressive scanning or interlaced scanning Progressive scanning iswhere all the lines of each frame are drawn in sequence. Interlacedscanning is where each frame is divided into 2 fields one containing allthe even lines of the frame and one containing all the odd lines.

Television broadcasts are typically captured using interlaced scanningThe rate depends on the television broadcast standard adopted. Forexample, the National Television System Committee (NTSC) standard is 60fields/sec (30 frames/sec). Older cathode ray tube (CRT) displays wereable to display interlaced video based on their complete analog nature.However, current displays, such as liquid crystal displays (LCD),digital light processing (DLP), and plasma are inherently digital inthat the display includes discrete pixels and therefore can not displayinterlaced video. Accordingly, these displays need to combine the evenand odd fields into a single frame for display. However, as the fieldsof the frame were shot at different times simply combining the imageswill result in various visual defects. A de-interlacing process isneeded for the display to create a progressive scanning video from theinterlaced video that limits the visual defects.

Motion pictures (movies) are typically captured on 24 frames (stillimages) per second film using progressive scanning A process known as“telecine” may have been used to convert the motion picture from theformat of 24 frames per second to the 60 fields per second rate utilizedby an NTSC broadcast television network. The telecine process includesrepeating frames according to a certain pattern, known as a pull-downpattern, to convert the 24 frames to 60 fields. In order to present themovies on a display without affecting the quality of the original 24progressive frames, the display needs to perform an inverse telecineoperation to reverse the pull-down pattern and discard the repeatedframes.

A display may receive interlaced video or video with various telecinepull-down patterns (various film modes). The display therefore needs tobe capable of performing de-interlacing and inverse telecine operations.In order to know what operations need to be performed on the receivedvideo, the display needs to determine the film mode of the video. If adisplay incorrectly indentifies the film mode of the video, the wrongprocessing may be performed on the video. For example, if the displayprocesses a telecine video as an interlaced video or processes atelecine video with the wrong inverse telecine operations the videopresented on the display may have visual defects (e.g., lost detail,combing artifacts).

BRIEF DESCRIPTION OF THE DRAWINGS

The features and advantages of the various embodiments will becomeapparent from the following detailed description in which:

FIG. 1 illustrates an example conversion of an interlaced video receivedby a display to a progressive video that can be drawn on the display;

FIG. 2 illustrates an example 3:2 pull-down to convert 24 progressiveframes (e.g., movie frames) to 60 fields for transmission by thetelevision broadcast network;

FIG. 3 illustrates an example conversion of telecine video received by adisplay to the original progressive video;

FIG. 4 illustrates an example video system, according to one embodiment;

FIG. 5 illustrates a high level flow diagram of an example film modedetection process, according to one embodiment;

FIG. 6 illustrates a high level flow diagram of an example pull-downmode determination process, according to one embodiment;

FIG. 7 illustrates a high level flow diagram of an example pull-downmode determination process, according to one embodiment;

FIG. 8 illustrates a high level flow diagram of a mode based film modedetection process, according to one embodiment;

FIG. 9 illustrates a high level flow diagram of a mode based trackingprocess, according to one embodiment; and

FIG. 10 illustrates an example video entertainment system where videocontent may be received from multiple sources, according to oneembodiment.

DETAILED DESCRIPTION

De-interlacing video for presentation on a display may require that oneor more fields be buffered so they can be combined into full frames.De-interlacing techniques may include field combination techniques(e.g., weaving, blending) that take the even and odd fields and combinethem into one frame, field extension techniques (e.g., half sizing, linedoubling) that extend each field the entire screen to make a frame, andmotion compensation techniques that utilize a combination of the fieldcombination and field extension techniques.

FIG. 1 illustrates an example conversion of an interlaced video receivedby a display to a progressive video that can be drawn on the display.The interlaced video includes a plurality of fields that alternatebetween displaying even and odd fields of a frame. The interlaced videois de-interlaced using field combination techniques to combinesuccessive even and an odd fields to create a single therefrom.

The 24-to-60 frame rate conversion used to transport movies over theNTSC broadcast television network typically involves a so-called 3:2pull-down pattern. Initially each frame is converted into 2 identicalfields (rather then an odd field and even field as done with interlacedscanning) so that the 24 frames are now 48 fields. Then a frame may berepeated an additional time every so often (transmitted as 3 successivefields) in order to convert 48 fields to 60 fields. For example, a firstframe may be presented as 3 fields, a second frame may be presented as 2fields and so on so that every 4 frames are transmitted as 10 fields.That is, a new frame has been added after each four frames.

FIG. 2 illustrates an example 3:2 pull-down pattern to convert 24progressive frames (e.g., movie frames) to 60 fields for transmission bythe television broadcast network. Initially, as illustrated to the left,each of four frames A, B, C, D are presented as an even and odd field tocreate 8 fields. As illustrated on the right, a first frame A ispresented as three fields (even, odd, even), a second frame is presentedas two fields (odd, even), a third frame C is presented as three fields(odd, even, odd), and a fourth frame D is presented as two fields (even,odd). The four frames have now been presented as 10 fields.Extrapolating would result in 24 frames being converted to 60 fields fordelivery.

FIG. 3 illustrates an example conversion of telecine video received by adisplay to the original progressive video. The telecine video includes aplurality of frames where certain successive frames are the same. Asillustrated, frame A is transmitted three times, followed by frame B twotimes, and so on based on the use of a 3:2 pull-down pattern. Therecovered video keeps original frame A and discards the two repeated Aframes, keeps the original B frame and discards the repeated B frame,and so on based on the pull-down pattern utilized.

The 3:2 pull-down is not the only format that may be utilized totransmit film movies or other 24 frame/sec videos at 60 field/sec overthe television broadcast network. Some examples of other telecinepull-down patterns are: 2:2, 2:3:3:2, and 2:2:2:4. The differentpull-down patterns may be based on editing and/or post processing (e.g.,the addition of titles or other effects) performed on the video or maybe based on the format/speed the video was captured. In addition, thedisplays may receive video from other sources including DVD players,digital video recorders or the like that were recorded, stored ortransmitted at different telecine pull-down patterns.

FIG. 4 illustrates an example video system 400. The video system 400includes a video source 410, a video display driver 420 and a display430. The video source 410 may be local or may be remote. For example, alocal video source may be a video player (e.g., DVD player), a videorecorder (e.g., camcorder), or a computer. The remote video source maybe, for example, a video broadcast system provided by cable, telephoneor satellite providers (providing broadcast video and/or video ondemand) or a server for downloading videos over a network. The videoprovided by the video source 410 may have various film modes (e.g.,interlaced, telecine with various pull-down patterns) and the film modemay be different for different videos or may change within a video.

The video display driver 420 may be located within a television,computer, set top box, video player or the like. The video displaydriver 420 is to receive the video, determine the film mode of thevideo, and then convert the received video to an appropriate format fordisplay based on the film mode detected. The display 430 may be aseparate device or may be, for example, part of a television along withthe video display driver 420. The display 430 may be, for example, aliquid crystal display (LCD) or a plasma display.

The video display driver 420 may include an input interface 440, a filmmode detector 450, a video processor 460, and an output interface 470.The input interface 440 receives a video from the video source 410. Itshould be noted that the video display driver 420 (for example ifincluded in a television) may be capable of receiving video from aplurality of video sources and a user may be able to select which videois to be displayed, for example, with a remote control device (notillustrated). The input interface 440 may provide the video to the filmmode detector 450 and the video processor 460.

The film mode detector 450 may analyze the video and determine if thevideo is interlaced (even and odd fields) or progressive (completeframes). If the video is progressive the film mode detector 450 maydetermine the pull-down pattern utilized to convert the video from theformat it was captured at (e.g., 24 frames/second for motion pictures)to the format it was broadcast or stored at (e.g., 60 fields/second forNTSC television format). The film mode detector 450 may identify theframes that it believes are original frames and those that are repeatframes (may be part of the pull-down pattern analysis). As the film modemay change without notice, the film mode detector 450 may continually beanalyzing the received video to determine the current film mode. Theoperation of the film mode detector 450 will be discussed in more detaillater.

The film mode detector 450 provides the detected film mode to the videoprocessor 460. The video processor 460 processes the video received fromthe input 440 based on the detected film mode received from the filmmode detector 450 to create a progressive scanning video for display.For example, if the film mode detector 450 determines that the video isinterlaced, the video processor 460 may de-interlace the video. Thevideo processor 460 may be configured with a defined de-interlacingalgorithm or may include a plurality of algorithms with which to selectfrom.

If the film mode detector 450 determines that the video is progressiveand utilized a certain pull-down pattern (e.g., 3:2), the videoprocessor 460 can utilize the pattern to recreate the original video bykeeping or utilizing original frames while discarding or ignoringrepeated frames (specifically the frames repeated extra times, such asthe 3^(rd) successive transmission of a frame in a 3:2 pull-downpattern). In theory, the film mode detector 450 simply needs to identifya first original frame and the pull-down pattern and the video processor460 can follow the pattern therefrom in order to recreate the originalvideo.

The video processor 460 may subject the recovered video to a frame rateconversion in order to enhance perceived image quality. The videoprocessor 460 may make interpolations between successive images(original frames) to further increase perceived image quality. Aninterpolation between an original frame and a repeat of that originalframe (substantially identical frames) should preferably be avoided. Thepull-down pattern and/or the identification of original frames and/orrepeat frames provided by the film mode detector 450 should ensureinterpolations between substantially identical frames is avoided andthat each interpolation concerns two original frames or their respectivecopies.

The video processor 460 provides the progressive scanning video createdfrom the input video based on input from the film mode detector 450 tothe output interface 470. The output interface 470 provides a displaydriver signal to the display 430 in response to the created progressivescanning video. The output interface 470 may carry out various signalprocessing operations, such as, for example, amplification, levelshifting, bias voltage generation, and synchronization.

It should be noted that the film mode detector 450 and the videoprocessor 460 are illustrated as separate blocks to annotate thedifferent functions. This is not intended to limit the film modedetector 450 and the video processor 460 functions to being performed byseparate devices or to limit each of the functions to being performed bya single device. Rather, the film mode detector 450 and the videoprocessor 460 functions may be performed together on one or moredevices, separate on one or more devices, or some combination thereof.The functions may be performed by hardware, software or firmware.

For example, the video display driver 420 may include a processor (notseparately illustrated) and processor readable storage media (notseparately illustrated) having instructions stored therein that whenexecuted by the processor cause the processor to perform the videoprocessor 460 functions described above. The processor readable storagemedia may also have instructions stored therein that when executed bythe processor cause the processor to perform the film mode detector 450functions described above. Alternatively, the video display driver 420may include another processor (not separately illustrated) to performthe film mode detector 450 functions described above when it executesthe instructions stored in the processor readable storage media.

The film mode detector 450 may determine the film mode in any number ofmethods utilizing any number of algorithms. Typically, the methodsentail some subset of measuring certain parameters for the receivedvideo, analyzing the measurements, storing a history of the measurementsand/or results of the analysis, and analyzing the history.

FIG. 5 illustrates a high level flow diagram of an example film modedetection process. When frames are received they are initially analyzedto determine if they contain data for the entire frame or only for theodd or even lines of the frame (fields) 500. A determination is made asto whether the frames are actually fields 510. If the determination isthat the frames are fields (510 Yes), then an interlaced mode isselected and this mode is provided to the video processor to performde-interlacing 520. The process then continues with the frame/fieldanalysis for the next frame received 500. If the determination is thatthe frames are frames (510 No), then measurements are calculated for theframes and analysis is undertaken based thereon to determine thepull-down mode utilized 530. Examples of the measurements and analysisthat may occur in order to determine the pull-down mode utilized will bediscussed in more detail later.

A determination is made as to whether the measurements/analysis match acertain pull-down mode 540. If the determination is that a pull-downmode (e.g., 3:2 pattern) has been matched (540 Yes), then that pull-downmode (pattern) is selected as the mode and the selected mode is providedto the video processor to perform a reverse pull-down 550. The processthen continues with the frame/field analysis for the next frame received500. If the determination is that a pull-down mode has not been matched(540 No), then the process continues with the frame/field analysis forthe next frame received 500.

FIG. 6 illustrates a high level flow diagram of an example pull-downmode determination process (e.g., measurements and analysis 530 of FIG.5). Initially, received frames are compared to previous frames and thedifferences between the frames are calculated 600. Alternatively, thesimilarities may be calculated or some type of correlation value may becalculated. A determination is made as to whether the frame is a newframe or a repeat frame based on the differences calculated 610. Forexample, if the differences are below a certain threshold the imagepresented on the frame may be determined to be the same as a previousframe and thus may be classified as a repeat frame. Alternatively, ifthe differences are above a certain threshold it may be determined thatthe image is different and thus the frame is new.

The new/repeat frame identifications may be stored in a register 620.The new/repeat pattern captured in the register may be compared tonew/repeat patterns for known pull-down modes 630. A determination ismade as to whether there is a match to a certain pull-down mode 640. Ifthe pattern captured matches a known pattern to some level of certainty(640 Yes), the associated pull-down mode may be selected as the filmmode 650. For example, for a 3:2 pull-down mode the following frameorder may be followed A, A, A, B, B, C, C, C, D, D so that thenew/repeat pattern was new, repeat, repeat, new, repeat, new, repeat,repeat, new, repeat and so. If the pattern captured in register matchedor was similar to this pattern this may be an indication that thepull-down mode was 3:2.

The comparison 630 may entail calculating some type of correlation valuebetween the new/repeat identification pattern captured in the registerand associated patterns for known pull-down modes. The number of framesconsidered in the comparison (e.g., correlation) may vary based on thepull-down mode. The determination 640 may select a mode if thecorrelation value for that mode exceeds a threshold (e.g., 95%correlation). According to one embodiment, the comparison 630 mayinclude generation of a short term correlation (e.g., no more then 2pattern sequences) and a long term correlation (e.g., 6 or more patternsequences) and the determination 640 may select a mode if the shortterm, long term, or both correlations exceed defined thresholds.

After the mode is selected 650 it is provided to the video processor toperform a reverse pull-down. The process then continues with thedifference calculation for the next frame 600. If there is no match (640No), then the process also returns to 600.

FIG. 7 illustrates a high level flow diagram of another examplepull-down mode determination process (e.g., measurements and analysis530 of FIG. 5). Initially, for frames received a previous frame iscompared to a next frame and the differences between the frames arecalculated 700. Alternatively, the similarities may be calculated orsome type of correlation value may be calculated. A determination ismade as to whether the previous and next frame are the same or not basedon the differences calculated 710. For example, if the differences arebelow a certain threshold the frames may be considered the same or ifthe differences are above a certain threshold they may be considereddifferent.

The determination of whether the previous/next frames are the same maybe stored in a register 720. The previous/next similarity patterncaptured in the register may be compared to previous/next similaritypatterns for known pull-down modes 730. For example, for the frame orderA, A, A, B, B, C, C, C, D, D presented using the 3:2 pull-down mode, theprevious/next similarity pattern may be different (no previous frame tocompare), same, different, different, different, different, same, anddifferent (no next frame to compare). A determination is made as towhether there is a match to a certain pull-down mode 740. If theprevious/next similarity pattern captured matches a known pattern tosome level of certainty (740 Yes), the associated pull-down mode may beselected as the film mode 750.

The comparison 730 may entail calculating some type of correlation valuebetween the pattern captured in the register and associated patterns forknown pull-down modes. The number of frames considered in the comparison(e.g., correlation) to known pull-down mode patterns may vary based onthe pull-down mode. The determination 740 may select a mode if thecorrelation value for that mode exceeds a threshold (e.g., 95%correlation). According to one embodiment, the comparison 730 mayinclude generation of multiple correlations and the determination 740may select a mode if one, some combination, or all correlations exceeddefined thresholds.

After the mode is selected 750 it is provided to the video processor toperform a reverse pull-down and the process then restarts 700 for thenext frame. If there is no match (740 No), then the process alsorestarts 700 for the next frame.

Looking at the pattern for the 3:2 pull-down mode shows that for any 5consecutive frames there should only be one previous/next match or forany six consecutive frames there should be one or two matches (twomatches if the matches are in the first and last frame of the sixconsecutive frame sequence). Likewise other pull-down modes may havesimilar matching counts per a particular frame count. According to oneembodiment, counters may be utilized to count the number the matchesover a particular frame count and a comparison of the counters to knownvalues may be done to determine an appropriate pull-down mode.

FIGS. 5-7 describe relatively simple examples of some methods that maybe utilized to determine the film mode and are in no way intended tolimit the film mode methods that may be utilized. These methods mayinclude additional details that are not captured in these high levelprocess flows. Other methods utilized may be much more complex, maycalculate and analyze multiple measurements, and/or may compare severalpatterns in order to select a mode without departing from the scope. Forexample, the methods described with respect to FIGS. 6 and 7 could becombined in some fashion.

As illustrated in FIGS. 5-7, the determination of the film mode istypically based purely on the collected data and does not take thecurrent film mode into account (algorithms are modeless). Not basing thealgorithm on the current film mode may result in the film mode detector450 having stability issues (e.g., switching modes when not required).

For example, a small amount of noise in the received video may result inone or more inaccurate measurements that may result in a determinationof a new mode (a mode change) even though the video has not changedmodes. Likewise noise in one or more measurements taken and/or recordedmay result in an inaccurate mode change determination. Noise in ameasurement that is captured in history may not be accounted for and mayaffect the analysis of the history and may result in an inaccurate modechange determination.

Referring back to FIG. 6, a small amount of noise in the calculation ofthe frame differences 600 may result in a new frame being classified asa repeat frame (or vice versa) 610. This results in a different patternbeing captured in the registers 630 and may result in a match to adifferent film mode 650.

By way of another example, if the received video includes a static (orrelatively static) image being presented for a period of time theanalysis may not be able to determine what pull-down pattern isassociated therewith (not match any know pull-down patterns) as theanalysis may determine that the same frame is presented over and over. Acorrelation measurement for each known pull-down pattern may provide aclose and possibly exact same measurement. In such cases, the film modedetector may opt to not perform any reverse pull-down or may select adefault film mode pattern (which may not correlate to the current modethat is still viable).

Referring back to FIG. 7, if the video was relatively static for aperiod of time the calculation of differences between previous/nextframes 700 and the determination/identification of whether they are thesame or not 710 may result in a plurality of same determinations beingstored in the register 730 which may not match any pattern 740 No. Aftersome period of time where no mode (including the current mode) isdetected, the film mode detector may opt to not perform any reversepull-down and may just present the video received (including repeatingframes). Alternatively, or at a later point in time, the film modedetector may select a default film mode that may be different then thecurrent mode (which may still be accurate).

According to one embodiment, the film mode detector 450 may keep trackof the current film mode. The film mode detection may proceed as before,and if a determination is made that a new film mode is being utilizedthe new film mode will be selected and provided to the video processor460. In a case where the current measurements support selection of a fewmodes, a determination may be made as whether the current mode issupported and if so the current mode may be maintained. In a case wherea mode can not be determined, for example based on the video presentinga static image for a period of time, the current mode may be maintainedrather then switching to no mode, or a default mode. Such aconfiguration provides mode stability in the form of consistency in theselection of a mode when multiple modes or no modes may be in play forselection. However, the use of the current mode in this fashion does notaccount for the stability issue that may result when a small amount ofnoise captured in a measurement causes a change in mode selected.

According to one embodiment, the film mode detector 450 may utilize acurrent film mode in determining future modes. Until a mode is selectedthe methods for selecting the mode may stay the same (e.g., the methodsdescribed with respect to FIGS. 5-7). Once the mode has been selectedthe film mode detector 450 may switch to an operational mode that takesinto account the current mode of the system (mode based operations). Themode based operations may predict a next measurement and then averagethe actual measurement with the predicted measurement to generate anaverage value as the final result. The averaged value may then be usedto predict a next measurement. The mode based operations may improvemeasurement accuracy when a small amount of noise is captured. The modebased operations my be based on operational use of a Kalman filter toimprove measurement accuracy in a noisy environment.

FIG. 8 illustrates a high level flow diagram of a mode based film modedetection process. Initially, for each frame that is receivedtraditional film mode detection is utilized 800. The traditional filmmode detection may include, for example, methods like those discussedwith respect to FIGS. 5-7. A determination is made as to whether a filmmode has been selected 810. If a mode has not yet been selected (810No), then the traditional film mode detection methods are utilized 800.If a mode has been selected (810 Yes), then mode based tracking isinitiated 820.

As noted above, mode based tracking may entail predicting measurementsbased on the mode and then averaging the predicted measurements with theactual measurements. The averaged measurement may be utilized to makefuture predictions. Use of the averaged measurement for analysis andfurther predictions may limit the effect of noisy measurements on modeselection. The mode based tracking 820 may predict results for one ormore measurements to be taken in the film mode detection methodologyutilized. The mode based tracking 820 may also define a range ofacceptable values (or define out of range values) for one or moremeasurements to be taken in the film mode detection methodologyutilized. Based on the measurements and analysis performed in the modebased tracking 820, a determination is made as to whether the mode basedtracking is successful 830. Success may be based on the averagedmeasurements resulting in continued selection of the current mode or themeasurements being within a defined acceptable range (or not in thedefined out of range).

If the mode based tacking is considered successful (830 Yes), the modebased tracking 820 continues. If the mode based tacking is notconsidered successful (830 No), the process returns to the traditionalfilm mode detection 800.

FIG. 9 illustrates a high level flow diagram of a mode based trackingprocess (e.g., 820 of FIG. 8). This process is similar to the processillustrated and discussed with respect to FIG. 6 (new/repeat framepatterns). Initially, a current frame is compared to a previous frame900. In a methodology where mode was not considered this would simplyentail calculating the differences (e.g., 600 of FIG. 6). In a modebased methodology, the comparison 900 includes predicting thecorrelation between the current and previous frames based on thepull-down mode selected 905, calculating the correlation 910 andaveraging the predicted value and the measured/calculated value 915. Adetermination is made as to whether the frame is a new frame or a repeatframe based on the averaged correlation value 920.

Below is an example of how utilizing a prediction based on the pull-downmode selected may remove potential errors caused by noise in themeasurements. Assume that a frame is determined to be a new frame ifthere is less than 90% correlation between it and a previous frame.Assume that noise in the correlation measurement of a repeating frameresulted in a correlation of 89%. This would result in the repeatingframe being erroneously classified as a new frame. If the predictedcorrelation value was 97% (based on the fact that according to thepattern the frame would be a repeat frame) then the averaged correlationvalue would be 93% and the repeating frame would be accuratelyidentified as such.

The new/repeat frame identifications may be stored in a register 930.The new/repeat frame pattern stored in the register is compared to thepattern associated with the selected pull-down mode 940. In amethodology where mode was not considered, the new/repeat pattern storedin the register would be compared to (correlated with) new/repeatpatterns for known pull-down modes (e.g., 630 of FIG. 6). In the modebased tracking, the comparison 940 includes predicting a correlationbetween the stored pattern and a pattern associated with the selectedpull-down mode 945, calculating the correlation 950, and averaging thepredicted value and the measured/calculated value 955. A determinationis then made as to whether the current mode is still supported based onthe averaged correlation value 960 (e.g., is the averaged correlationabove a defined threshold correlation). If the current mode is supported(960 Yes), the process returns to 900. If the current mode is notsupported (960 No), the process returns to non mode based film modedetection 970 (e.g., 800 of FIG. 8).

Below is an example of how utilizing a prediction based on the pull-downmode selected may remove potential errors caused by noise in themeasurements. Assume that the stored pattern is determined to match apattern associated with current pull-down mode if there is at least a90% correlation therebetween. Assume that noise in the correlationmeasurement resulted in a correlation of 89%. This would result in adetermination that the current pull-down mode was no longer supported.If the predicted correlation value was 97% (based on the fact that thepattern was expected) then the averaged correlation value would be 93%and a determination that the current pull-down mode was supported wouldaccurately be made.

By way of another example, assume that a repeating frame was erroneouslyclassified as a new frame based on noise in the measurement. Theerroneous classification may result in a lower pattern correlation valuebeing calculated. As noted above, the predicted value could pull theaveraged correlation value up so that an accurate determination wasmade.

The use of predicted values can be utilized with any film mode detectionmethodology to make the methodology mode based. Some or all of themeasurements made within a particular methodology may be predicted.

FIG. 10 illustrates an example video entertainment system where videocontent may be received from multiple sources. The display device inthis system is a TV 1000 which may be capable of receiving progressivescanning video, interlaced scanning video, or progressive scanning videotransported or stored to a different rate using a telecine processhaving a particular pull-down pattern (telecine video). Accordingly, theTV 1000 may utilize mode based film mode detection to detect the filmmode associated with the video and may modify the received video asrequired based on the film mode detected. While not illustrated the TV1000 may include embedded circuitry capable of detecting the film modeand processing accordingly.

The TV 1000 may receive video from multiple sources. While notillustrated the TV 1000 may include a plurality of interfaces to receivevideo from the multiple sources via a plurality of mediums (e.g., cable,telephone, HDMI). For example, the TV 1000 may receive video from abroadcast network 1010. The TV 1000 may receive video directly from thebroadcast network 1010 or via a set top box (STB) 1020, a digital videorecorder (DVR) 1030, or computer 1040. If the STB 1020, DVR 1030, and/orcomputer 1040 receive interlaced and/or telecine video they may transmitit to the TV 1000 or they may utilize mode based film mode detection todetect the film mode associated with the video and create a progressivescanning video from the received video based on the film mode detectedand provide the progressive scanning video to the TV 1000 for display.While not illustrated the STB 1020, DVR 1030, and/or computer 1040 mayinclude embedded circuitry capable of detecting the film mode andprocessing accordingly.

The TV 1000 may also receive video directly from the computer 1040. Thevideo may be video that was downloaded from another source, was createdand/or edited thereon, or is being played thereon (e.g., a DVD) androuted to the TV. As noted above the computer may utilize mode basedfilm mode detection.

The TV 1000 may also receive video from a DVD player 1050. As gameconsoles may have play DVDs they will be considered here as well. TheDVD player 1050 may be capable of playing DVDs having progressive scanvideo stored thereon as well as DVDs having interlaced and/or telecinevideo stored thereon. The DVD player 1050 may transmit the interlacedand/or telecine video to the TV 1000 or may utilize mode based film modedetection to detect the film mode associated with the video and create aprogressive scanning video from the received video based on the filmmode detected and provide the progressive scanning video to the TV 1000for display. While not illustrated the DVD player 1050 may includeembedded circuitry capable of detecting the film mode and processingaccordingly.

The TV 1000 may also receive video from a video recorder 1060. The videorecorder may create and/or edit video at various cadences.

The various embodiments described above may incorporated in variouselectronic devices that provide video to a display, may be capable ofproviding video to a display, or may in the future be capable ofproviding video to a display, including, for example, a television,digital video disk (DVD) player, set top box (STB), digital videorecorder (DVR), personal computer (PC), laptop computer, ultra-laptopcomputer, tablet, touch pad, portable computer, handheld computer,palmtop computer, personal digital assistant (PDA), cellular telephone,combination cellular telephone/PDA, smart device (e.g., smart phone,smart tablet or smart television), mobile internet device (MID),messaging device, data communication device, and so forth.

Although the disclosure has been illustrated by reference to specificembodiments, it will be apparent that the disclosure is not limitedthereto as various changes and modifications may be made thereto withoutdeparting from the scope. Reference to “one embodiment” or “anembodiment” means that a particular feature, structure or characteristicdescribed therein is included in at least one embodiment. Thus, theappearances of the phrase “in one embodiment” or “in an embodiment”appearing in various places throughout the specification are notnecessarily all referring to the same embodiment.

The various embodiments are intended to be protected broadly within thespirit and scope of the appended claims.

What is claimed:
 1. A method comprising: receiving a video from a videosource; capturing data for the video; predicting data for the videobased on a determination of a particular film mode for the video;averaging the captured data and the predicted data; and comparing theaveraged data to known parameters for the particular film mode todetermine if the particular film mode is valid.
 2. The method of claim1, wherein the predicting, the averaging and the comparing are repeatedif the particular film mode is determined to be valid.
 3. The method ofclaim 1, wherein the particular film mode is determined to be valid ifthe averaged data meets or exceeds the known parameters.
 4. The methodof claim 1, wherein the particular film mode is determined to be validif the averaged data and the known parameters meet or exceed a thresholdcorrelation.
 5. The method of claim 1, further comprising comparing thecaptured data to known parameters for a plurality of possible film modesuntil a determination is made that the video has the particular firmmode.
 6. The method of claim 5, wherein the predicting, the averagingand the comparing the averaged data are performed subsequent to thedetermination of the particular film mode.
 7. The method of claim 5,wherein the comparing the captured data to known parameters for aplurality of possible film modes is performed if the particular filmmode is determined to be invalid.
 8. The method of claim 1, furthercomprising processing the video based on the particular film mode.
 9. Avideo display driver comprising: an input interface to receive a video;a film mode detector to: until a film mode is detected for the video,continually capturing data for the video and comparing the captured datato known parameters for a plurality of possible film modes; and once thefilm mode has been detected, continually capturing the data for thevideo, predicting data for the video based on the film mode, averagingthe captured data and the predicted data, and comparing the averageddata to known parameters for the film mode to determine if the film modeis valid; a video processor to process the video based on the film mode;and an output interface to provide the processed video to a display. 10.The video display driver of claim 9, wherein the film mode detector mayinitially determine if the video is interlaced.
 11. The video displaydriver of claim 9, wherein the film mode detector detects the film modewhen a comparison between the captured data and the known parameters forthe film mode meet or exceed a threshold.
 12. The video display driverof claim 9, wherein the film mode detector is to calculate measurementsfor frames in the video and analyze the measurements, and wherein thecaptured data includes at least some subset of the measurements and theanalysis.
 13. The video display driver of claim 12, wherein the filmmode detector is to predict at least some subset of the captured data.14. The video display driver of claim 9, wherein the film mode detectordetermines the film mode is valid when a comparison between the averageddata and the known parameters for the film mode meet or exceed athreshold.
 15. The video display driver of claim 9, wherein the filmmode detector returns to continually capturing data for the video andcomparing the captured data to the known parameters for the plurality ofpossible film modes if the film mode is determined to be invalid. 16.The video display driver of claim 15, wherein the film mode detectormaintains the film mode until a new film mode is detected.
 17. A videoentertainment system comprising: a video source to provide a video; afilm mode detector to: until a film mode is detected for the video,continually capturing data for the video and comparing the captured datato known parameters for a plurality of possible film modes; and once thefilm mode has been detected, continually capturing the data for thevideo, predicting data for the video based on the film mode, averagingthe captured data and the predicted data, and comparing the averageddata to known parameters for the film mode to determine if the film modeis valid; a video processor to process the video based on the film mode;and a display device to display the processed video.
 18. The videoentertainment system of claim 17, wherein the display is a televisionand the television includes the film mode detector and the videoprocessor.
 19. The video entertainment system of claim 17, wherein thevideo source is a digital video recorder (DVR) and the DVR includes thefilm mode detector and the video processor.
 20. The video entertainmentsystem of claim 17, further comprising a set-top box (STB) between thevideo source and the display, wherein the STB includes the film modedetector and the video processor.
 21. A processor readable storagemedium storing instructions, wherein when the instructions are executedby the processor they cause the processor to: continually capture datafor a video; continually compare the captured data to known parametersfor a plurality of possible film modes until a determination is madethat the video is associated with a particular film mode; subsequent tothe video being associated with the particular film mode, continuallypredict data for the video based on the particular film mode; averagethe captured data and the predicted data, and compare the averaged datato known parameters for the particular film mode until a determinationis made that the video is no longer associated with the particular filmmode.
 22. The processor readable storage medium of claim 21, whereinwhen executed by the processor the instructions further cause theprocessor to determine the video is associated with the particular filmmode when a comparison between the captured data and the knownparameters for the particular film mode meet or exceed a threshold. 23.The processor readable storage medium of claim 21, wherein when executedby the processor the instructions further cause the processor tocalculate measurements for frames in the video; and analyze themeasurements, and wherein at least some subset of the measurements andthe analysis are at least part of the data continually captured.
 24. Theprocessor readable storage medium of claim 23, wherein when executed bythe processor the instructions cause the processor to predict at leastsome subset of the measurements and the analysis that are part of thecaptured data.
 25. The processor readable storage medium of claim 21,wherein when executed by the processor the instructions further causethe processor to determine the video is no longer associated with theparticular film mode when a comparison between the averaged data and theknown parameters for the film mode fall below a threshold.
 26. Theprocessor readable storage medium of claim 21, wherein when executed bythe processor the instructions further cause the processor to processthe video based on the particular film mode.